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Abstract 



The random coefficient integer-valued autoregressive process was introduced by 
Zheng, Basawa, and Datta in |54| . In this paper we study the asymptotic behavior of 
fV| ■ this model (in particular, weak limits of extreme values and the growth rate of partial 

Ph . sums) in the case where the additive term in the underlying random linear recursion 

belongs to the domain of attraction of a stable law. 
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1 Introduction 

cn 

Tj- ! In this paper we consider a first-order random coefficient integer-valued autoregressive (ab- 
breviated as RCINAR(l)) process that was introduced by Zheng, Basawa, and Datta in 
|54j . While the article [M] as well as a subsequent work have been focused mostly on direct 
statistical applications of the model, the primary goal of this paper is to contribute to the 
understanding of its probabilistic structure. 

Let $ := (<fi n )nez be an i.i.d. sequence of reals, each one taking values in the closed 
interval [0, 1]. Further, let Z := [Z n ) n ^% be a sequence of i.i.d. integer- valued non-negative 
random variables, independent of $. The pair ($, Z) is referred to in [51] as a sequence of 
random coefficients associated with the model. 

Let Z + denote the set of non-negative integers {n G Z : n > 0}. The RCINAR(l) process 
X := (X n ) neZ+ is then defined as follows. Let B := (B n)k ) ne z,kez be a collection of Bernoulli 
random variables independent of Z and such that, given a realization of $, the variables 
B n ^ are independent and 

P*{B n , k = 1) = 4> n and P*(B„ lfc = 0) = 1 - n , VfceN, 
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where P<$> stands for the underlying probability measure conditional on $. Let X$ = and 
consider the following linear recursion: 

k=l 

where we make the usual convention that an empty sum is equal to zero. To emphasize 
the formal dependence on the initial condition, we will denote the underlying probability 
measure (i.e., the joint law of Q,Z,B, and X) conditional on {X = 0} by P an d denote 
the corresponding expectation by E . For the most of the paper we will consider a natural 
initial assumption X = and hence consistently state our results for the measure Pq. We 
remark however that all our results (stated below in Section [5]) are robust with respect to 
the initial condition X Q . 

The RCINAR(l) process X defined by (Op) is a generalization of the integer-valued au- 
toregressive of order one (abbreviated as INAR(l)) model, in which the parameters <p n are 
deterministic and identical for all n G Z. The model introduced in [51] has been further 
extended in [121 [501 15D E21 E31 IM] - We refer the reader to [251 ES ESI SB] for a general 
review of integer-valued (data counting) time series models and their applications. 

Formally, RCINAR(l) can be classified as a special kind of branching processes with 
immigration in the random environment $, cf. [28]. In particular, the process can be 
rigorously constructed on the state space of "genealogical trees" (see [231 Chapter VI]). 
The random variable X n is then interpreted as the total number of individuals present at 
generation n. At the beginning of the n-th period of time, Z n immigrants enter the system. 
Simultaneously and independently of it, each particle from the previous generation exits the 
system, producing in the next generation either one child (with probability ra ) or none (with 
the complementary probability 1 — <p n ) Q. The branching processes interpretation is a useful 
point of view on RCINAR(l) which provides powerful tools for the asymptotic analysis of 
the model. 

Let A/+ denote the set of non-negative integer- valued random variables in the underlying 
probability space. The first term on the right-hand side of (PQ) can be thought of as the result 
of applying to X n a binomial thinning operator which is associated with (fi n . More precisely, 
using the following operator notation introduced by Steutel and van Harn in [35] : 

x 

(p n oX := ^5 n ,fe, XeM+, 

n=l 

equation ([1]) can be written as 

X n = <J) n o A n _! + Z n , ne N. (2) 

This form of the recursion indicates that an insight into the probabilistic structure of the 
RCINAR(l) process can be gained by comparing it to the classical AR(1) {first-order autore- 
gressive) model for real- valued data. The latter is defined by means of i.i.d. pairs (<f) n , Z n ) n( zz 

1 Alternatively, one can think that each particle either survives to the next generation (with probability 
4> n ) or dies out (with probability 1 — <f> n )- 
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of real-valued random coefficients, through the following linear recursion: 

Y n = (t) n Yn-i + Z n , neN. (3) 

In this paper we explore one of the aspects of the similarity between the RCINAR(l) and 
AR(1) processes. Namely, we show in Theorem 12.51 below that if Z n are in the domain 
of attraction of a stable law so is the limiting distribution of X n , and then consider some 
implications of this result for the asymptotic behavior of the sequence X n . A prototype of our 
Theorem 12.51 for AR(1) processes has been obtained in [201 122]. Our proof of Theorem 12.51 
relies on an adaptation of the technique which has been developed in |20j . 

We conclude the introduction with the following remarks on the motivation for our study. 
Although it appears that most of our results (stated in Section [2] below) could be extended to 
a more general type of processes than is considered here, we prefer to focus on one important 
model. It is well-known that certain quenched characteristics of branching processes in 
random environment satisfy the linear difference equation ([3]). In two different settings, both 
yielding stationary solutions to with regularly varying tails, this observation has been used 
to obtain the asymptotic behavior of the extinction probabilities in a branching processes 
in random environment [20| [2Tj and the cumulative population for branching processes in 
random environment with immigration [27J [28] . These studies make it appealing to consider 
a model like ([2]) which evidently combines features of both branching processes in random 
environment (with immigration) and AR(1) time series. 

In general, probabilistic analysis of the future behavior of average and extreme value 
characteristics of the underlying system might be handy for typical real-world applications 
of a counting data model. Our results thus constitute a natural complement to the statistical 
inference tools developed for the RCINAR(l) processes in [54j. For the sake of example, 
consider 

1) maximal number of unemployed per month in an economy, according to the model 
discussed in [3U Section 1]; 

2) a variation of the model for city size distributions studied in [T71 [18] where the underly- 
ing AR(1) equation is replaced by its suitable integer-valued analogue. More precisely, 
while it is argued in jTTl [18] that the evolution of the normalized (to the total size of the 
population) size of a city Y n obeys (EJ), we propose as a possible alternative model 
for non-normalized size of the city population X n , where n is an average proportion 
of the population which will continue to live in the city in the observation epoch n + 1 
and Z n is the factor accumulating both the natural population growth and migration; 

3) total number of arrivals in the random coefficient variation of the queueing system 
proposed in [IJ Section 3.2]. 

On the technical side, in contrary to [31], we do not restrict ourselves to a setup with 
E[Zq] < oo. This finite variance condition apparently does not pose a real limitation on 
the possibility of applications of RCINAR(l) to, say, the unemployment rate and the cities 
growth models mentioned above. In both the cases, it is reasonable to assume that the 
innovations Z n are typically relatively small comparing to X n and, furthermore, large fluctu- 
ations of their values are not very likely to occur. However, the situation seems to be quite 
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different if one wishes to apply the theory of RCINAR(l) processes to the models of queueing 
theory (as it has been done in pQ) when the latter are assumed to operate under a heavy 
traffic regime. See, for instance, [U El [HI EH EBJ ES] and [TJ EHJ H2] for queueing network 
models where it is assumed that the network input has sub-exponential or, more specifically, 
regularly varying distribution tails (typically resulting from the distribution of the length of 
ON/OFF periods). We remark that the extensive literature on queueing networks in a heavy 
traffic regime is partially motivated by the research on the Internet network activity where 
it has been shown that in many instances a web traffic is well-described by heavy-tailed 
random patterns; see, for instance, [121 E21 EH EH]- 

2 Statement of results 

This section contains the statement of our main results, and is structured as follows. We 
start with a formulation of our specific assumptions on the coefficients ($, Z) of the model 
(see Assumptions 12.11 and 12.21 below). Proposition 12.31 then ensures the existence of the 
limiting distribution of X n and also states formally some related basic properties of this 
Markov chain. Theorem 12.51 is concerned with the asymptotic of the tail of the limiting 
distribution in the case where the additive coefficients Z n belong to the domain of attraction 
of a stable law. The theorem shows that in this case, the tails of the limiting distribution 
inherit the structure of the tails of Zq. This observation leads us to Theorem 12.61 which is 
an extreme value limit theorem for the sequence (X n ) n& i + . Weak convergence of suitably 
normalized partial sums of X n is the content of Theorems 12.111 and 12.121 The proof of these 
limit theorems exploit the branching process representation of a regenerative structure which 
is described by Proposition 12. 71 Two curious implications of the existence of this regenerative 
structure are stated in Propositions I2.8l and 12.91 The proofs of main theorems stated below in 
this section are given in Section [3] while the proofs of two auxiliary propositions are deferred 
to the Appendix. 

Specific assumptions on the random coefficients. Recall that a function / : R — > R 
is called regularly varying if f(t) = t a L(t) for some a G R and a function L such that 
lim^oo L(\t)/L(t) = 1 for all A > 0. The parameter a is called the index of the regular 
variation. If a = 0, then / is said to be slowly varying. We will denote by 7Z Q the class 
of all regularly varying real- valued functions with index a. We will impose the following 
assumption on the coefficients of the model defined by ([]]). 

Assumption 2.1. 

(Al) P(0 O = 1)<1. 

(A2) For some a > 0, there exists h e TZ a such that lim^oo h(t) ■ P(Z n > t) = 1. 

Throughout the paper we will assume (actually, without loss of generality in view of (A2) 
and Theorem 1.5.4 in [5] which ensures the existence of a non-decreasing equivalent for h) 
that the the following condition is included in Assumption 12.11 

(A3) Let h : (0, oo) ->■ R be as in (A2). Then sup t>0 h{t) ■ P(Z n > t) < oo. 
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The assumption of heavy-tailed innovations (noise terms) in autoregressive models is 
quite common in the applied probability literature. It is a well-known paradigm that such 
an assumption yields a rich probabilistic structure of the stationary solution and allows for 
a great flexibility in the modeling of its asymptotic behavior. See for instance J2UJ E2] , more 
recent articles [9j [TUl |2JJ [30J |371 031 01] , and references therein. 

In a few occasions (including a central limit theorem stated below in Theorem 12. 14j) we 
will use the following weaker version of Assumption 12.11 

Assumption 2.2. Condition (Al) of Assumption [Ol is satisfied and, in addition, the fol- 
lowing holds: 

(A4) E[Zq] < for some (3 > 0. 

Assumption 12.21 is stronger than the usual E(log + \Z \) < +oo, where x + := max{x, 0} 
for x G R, which is essentially required for the existence and uniqueness of the stationary 
solution to (T5]). It can be seen through the formula E[Zq] = J °° f3x /3 ~ 1 P(Z > x)dx (recall 
that Z > 0) that (A4) is basically equivalent to the assumption that the distribution tails 
of Z are "not too thick". 

Limiting distribution of X n . Let Y n =>■ stand for the convergence in distribution of 
a sequence of random variables {Y n ) n& m to a random variable (we will usually omit the 
indication "as n — > oo"). We will use the notation A =£> Y to indicate that the distributions 
of random variables X and Y coincide under the law P$. For X G A/+ define Ho o X := X 
and, recursively, LI^+i o X := 4>k+i ° ij^-k ° A). This defines a sequence of random operators 
acting in Af + as follows: 

U k o A = 0fc o fc _! o • • • o 0! o A, A 6 JV+- (4) 

The existence of the stationary distribution for the sequence X = (A n ) n >o introduced in ((T|) 
is the content of the following proposition. 

Proposition 2.3. Let Assumption \2.2\ hold. Then, 

(a) The following series converges to a finite limit with probability one: 

oo 

Aoo := Ap ; fc, (5) 

k=0 

where the random variables (Ao 5 fc)fcez+ are independent, and Xo,k =d ^-k ° Zq for any fceN. 

(b) X n Aqo for any A G Af + . Here (A n ) rag ^ + is understood as the sequence produced by 
the recursion rule (JTJ) with an arbitrary initial value Aq. 

(c) The distribution of 1^ t/ie unique distribution of Ao which makes {X n ) n& i + into a 
stationary sequence. 

The proof of the proposition is deferred to the appendix. We remark that if E[Zq] < oo 
is assumed, the above statement is essentially Proposition 2.2 in [31]. For a counterpart of 
this result for AR(1) processes see, for instance, Theorem 1 in [8]. It is not hard to deduce 
from the above proposition the following corollary, whose proof is omitted: 



5 



Corollary 2.4. Suppose that Assumption \2.2\ holds, and let X = (X n ) ne z + be a random 
sequence defined by (pQ). Then X is an irreducible, aperiodic, and positive-recurrent Markov 
chain whose stationary measure is supported on a set of integers {k G Z + : k > k m[n }, where 
Knin '■= min{&; G Z + : P(Z Q = k) > 0}. In particular, X is an ergodic sequence. 

It follows from the above proposition that Xoo is the unique solution to the distributional 
fixed point equation X =£> <p oX + Z which is independent of (0o> Bo, Zq), where B denotes 
the sequence (B Qik ) k( z?q. In fact, the explicit form dSJ) of the stationary distribution along with 
the identity (4> n , Z n ) neZ =d {4>-ni Z- n )n£Z, implies that the unique stationary solution to (DQ) 
is given by the following infinite series: 

n 

X n = X kjH , (6) 

k=— oo 

where the random variables (X kjn )kez are independent, and 

X k ,n =P <j>n-l ° 0n-2 O • • • O (j) k+l O Z k , k < U. 

By means of the branching process interpretation, 

X k , n = ^{progeny alive at time n of all the immigrants who arrived at time k}, (7) 

with the convention that X n ^ n = Z n and X k ^ n = for k > n. Thus ([6]) states that the 
stationary solution to ([T|) is formally obtained by letting the zero generation to be formed 
as a union of the following two groups of individuals: 

1. Zq immigrants arriving at time zero, and 

2. descendants, present in the population at time zero, of all "demo- immigrants" who has 
entered the system at the negative times k = —1, —2, . . . 

The random variables X k ^ n can be defined rigorously on the natural state space of the branch- 
ing process, which is a space of family trees describing the "genealogy" of the individuals 
(see [23, Chapter VI]). To distinguish between the branching process starting at time zero 
with Xq = and its stationary version "starting at time — oo", we will denote by P the 
distribution of the latter, while continuing to use Pq for the probability law of the former. 
We will denote by E the expectation operator associated with the probability measure P. We 
will use the notation X =p Y to indicate that the distributions of random variables X and 
Y coincide under the stationary law P. As it has been mentioned earlier, we will consistently 
state our results for the underlying process under the law P and thus will consider measure 
P as an auxiliary tool rather than a primary object of interest. 

In the case when the additive term in the underlying random linear recursion belongs to 
the domain of attraction of a stable law we have the following 

Theorem 2.5. Let Assumption \2. II hold. Then, 

lim h(t) ■ P(X 00 > t) = (1 - ^[^r 1 G (0, oo). 

A prototype of this result for AR(1) processes has been obtained in [20| [22] . The proof of 
Theorem 12.51 given in Section 13.11 relies on an adaptation to our setup of a technique which 
has been developed in [20J. 
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Extreme values of X. We next show that the running maximum of the sequence X 
exhibits the same asymptotic behavior as that of Z = (Z n ) ne % + . Let 

M n = max{X u . . . , X n }, n e N, (8) 

and 

b n = inf{t > : h(t) > n}, (9) 

where h(t) is the function introduced in Assumption 12.11 

The proof of the following theorem is given in Section 13.21 below. 

Theorem 2.6. Let Assumption \2. II hold. Then, under the law Pq, 

M n /b n Moo, 

where is a proper random variable with the following distribution function: 

PoiMcc >x) = e~ x ~ 1/a 1 £>0, 

where a > is the constant introduced in Assumption \2.1[ 

The distribution of belongs to the class of the so called Frechet extreme value dis- 
tributions and in fact (see, for instance, [151 Section 3.3]), 

Pq^Moo > x) = lim P( max > xb n ), x > 0. 

It is quite remarkable that the distribution of 0o does not play any role in the result of 
Theorem 12 .61 An intuitive explanation for this phenomenon, which can be derived from 
the proof, is as follows. Due to the basic property of regular variation, two independent 
terms <p n o A n _i and Z n are unlikely to "help" each other in creating a large value of the 
sum X n+ i = <p n o X n _! + Z n . Moreover, the law of large numbers ensures that the ratio 
4> n o X n _i/ X n _i is bounded away from one with an overwhelming probability whenever 
4> n o A„_i is large. Therefore, the asymptotic of the extreme value of the sequence X n 
follows that of Z n . 

Regenerative structure of X. Let 

z/ = 1 and v n = inf{i > z/ n _i : 0; o X^ x = 0}, (10) 

with the usual convention that the infimum over an empty set is oo. We will refer to u n as a 
regeneration time and to the time elapsing from v n _\ until v n — 1 as the n-th renewal epoch. 
In the language of branching processes, at the regeneration times the extinction occurs and 
and the process starts again with the next wave of the immigration. For n 6 N, let 

o- n = v n - v n -i and R n = (JQ : v n _ x < i < u n ) 

be, respectively, the length of the n-th renewal epoch and the list of the values of Xi recorded 
during the n-th renewal epoch. 

The proof of the following proposition is given in the appendix. 
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Proposition 2.7. Let Assumption [Ol hold. Then, 

(a) P${v n < oo) = 1 for all n G N. Moreover, the pairs (a n , R n ) n< z^ form an i.i.d. sequence. 

(b ) There exist positive constants K\ > and K% > such that 

Po(<ri >t)< K ie - K2 \ V t > 0. (11) 

While the first part of the proposition is a standard Markov chain exercise, the exponential 
bound in (TTTj) is a delicate result. A similar bound has been proved for a general type of 
branching processes with immigration in [25]. An argument which is due to M. Kozlov and 
which has been adapted for the proof of Theorem 4.2 in [28J goes through almost verbatim 
for our setting. We provide a suitable variation of this argument in the appendix. 

The existence of the "life-cycles" (i.e., renewal epochs) for the branching process implies, 
for instance, the following. Recall Xk, n from (jTJ). Let 

X n = n- m&x{k < n : X k<n > 0} and r] n = ^ fc= l^' n — - — — 

be, respectively, the maximal and the average age of the individuals present at generation n 
(see the above footnote remark on p.[2|. 

Proposition 2.8. Let Assumption \2.S\ hold. Then both X n and i] n converge weakly, as 
n — > 00, to proper distributions. More precisely, under the law P , 

A n =>• 01 • U and t] n — = ^ , 

where U is a random variable which is independent of o~\ and is distributed uniformly over 
the interval [0, 1]. 

The first result in the above proposition is a direct implication of the renewal theorem 
whereas the second one is a consequence of the explicit formula for r) n given above and the 
fact that Afc o = for k < i/_i and P(v~\ < 00) = 1. Here v_\ is time of the last renewal up 
to time zero for the process starting at —00. We leave details to the reader. 

Another interesting implication of the existence of the regenerative structure is the con- 
vergence in distribution of the coalescence time at generation n. Suppose that X n > 2 and 
sample at random two individuals present at generation n. Then the coalescence time T n is 
defined as n — k if the immigrant ancestors of both individuals have entered the system at 
the same time k G Z + , and is set to be infinity otherwise (cf., for instance, [31J). Since the 
probability of sampling of both individuals among the descendants of the immigration wave 

K lb X n (X n -l) ' 

Ylk=n-t X k,n( X k,n ~ 1) 



P (T n <t)=E 

We have thus obtained the following: 



8 



Proposition 2.9. Let Assumption \2.2\ hold. Then T n converges weakly under Pq, as n — >■ oo, 

to a proper random variable with the following distribution function on N|J{0, +00} : 



F(t) = E 



t < 00, 



where inside the expectation is interpreted as 0. 

Growth rate and fluctuations of the partial sums of X. Let S n = Y^k=i^k- The 
following law of large numbers is a direct consequence of Corollary 12.41 

Proposition 2.10. Let Assumption \2.2\ hold with (3 = 1. Then 

lim ^ = E[X ] = -EWL P - a .s. 

n->oo n 1 — E[(p \ 

The next theorem is concerned with the rate of the growth of the partial sums when Z 
has infinite mean. For a G (0, 2] and b > denote by C a ^ the strictly asymmetric stable law 
of index a with the characteristic function 

log£ a , b (t) = -b\t\ a (l + i±f a ( t )\ , (12) 

where f a (t) = — tan 5a if a ^ 1, = 2/7rlogt. With a slight abuse of notation we use 
the same symbol for the distribution function of this law. If a < 1, C a ^ is supported on the 
positive reals, and if a € (1,2], it has zero mean [T5], Section 2.2]. 

Recall b n from (Q. The following result is proved in Section 13.31 below by using an 
approximation of the partial sums of the process by those of a stationary strongly mixing 
sequence for which we are able to verify the conditions of a general stable limit theorem. 

Theorem 2.11. Let Assumption \2.1\ hold with a 6 (0, 1). Then &~ 1 5 n =>■ C a ^. 

We next study the fluctuations of the partial sums in the case where non-trivial centering 
of X n is required to obtain a proper weak limit for the partial sums. 

Theorem 2.12. Let Assumption \2.1\ hold with a G [1, 2]. For n G N, define 

b n , where b n is defined in (jHJ), if ct < 2, 

inf {t > : nt~ 2 ■ E [X 2 ; X < t] < 1} if a = 2. 

Denote \x := -E[X ]. Then the following holds for some b > : 
(i) If a = 1, i/ien a~ 1 (S'„ — c n ) =>■ wift c n = n_E[X ; X < a n ]. 
fuj If a G (1,2), i/ien a"^^ - n/f) =4> £ a , 6 . 
fmj If a = 2 and E[Zq] = 00, then a~ l (S n — njj) =^ C 2 ,b- 
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Recall v n from (ITU]) and define 

Vn—l 

Theorem 12.121 can be derived from stable limit theorems for partial sums of i.i.d. variables, 
using the regenerative structure and the following lemma. 

Lemma 2.13. Let Assumption \2. II hold. Then the following limit exists: 

lim h(t) -P (Wi >t). 

t—^oo 

Moreover, the limit is finite and strictly positive. 

The proof of the lemma given below in Section E3] is (although technical details are quite 
different) along the line of the proof of a similar result given for a different branching process 
in [27]. We remark that though a similar technique can be used to obtain Theorem I2.11[ 
we prefer to employe a more direct approach in the case a £ (0,1). Theorem 12.121 follows 
from the above lemma by using a standard argument, which is outlined in [27] in for the case 
h(x) = x^ 1 . Since only an obvious minor modification is required to extend the argument to 
a general h (see, for instance, [33] for h(x) = x~ 2 ), we omit details of this argument here. 

If an appropriate second moment condition is assumed, one can establish the following 
functional limit theorem for normalized partial sums of X. Let D(M. + ,K.) denote the set of 
real-valued cadlag functions on M + := [0, oo), endowed with the Skorokhod Ji-topology. Let 
\x\ denote the integer part of x £ M. We have: 

Theorem 2.14. Let Assumption \2.2\ hold with a constant (5 > 2. Then, as n — > oo, the 

sequence of processes 

Si n) = n- 1 / 2 (S [ntl -nt^), te[0,l). 
in D(M. + ,M.) converges weakly to a non- degenerate Brownian motion W t , t £ [0, 1]. 

Theorem 12 .141 is a particular case of [HI Theorem 1.5], and therefore its proof is omitted. 
Notice that the conditions of the theorem are satisfied if Assumption 12.11 holds with a > 2. 



3 Proof of the main results 

This section is devoted to the proof of the theorems stated in Section |2] (namely, Theo- 
rems [231 12. Ill and 12. 12j) . and is divided into four subsections correspondingly. 



3.1 Proof of Theorem [231 

First, we observe the following. 

Lemma 3.1. Let X £ A/+ be a random variable in the underlying probability space such that 
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(i) X is independent of (<f> n ,Z n ,B n ) neZ+ , where B n := (B n , k ) km . 

(ii) Hindoo h{t) ■ P$(X > t) = 1 for some h G 1Z a , a > 0. 
Then liim : _ ) . 00 ■ Pj>(0o ° X > t) = 0q . 

Proof of Lemma \3.1\ Fix a constant e G (0, 1). For t > define the following three events: 

A,e = {X>t-(<P 1 + e)}, 

B t ,e = {t-(<f )o 1 -6)<X<t-(^ 1 +e)}, 

C t , E = {XKt-i^-e)}. 

We will use the following splitting formula: 

Pj,(0o o X > t) = P$(0 O o X > t; A t>£ ) + P$(0 O o X > i; P M ) +P 4 (0 O o X > i; a, e ). 
By the law of large numbers, 



1 n 
lim - > Pi 



>!./, ■ o n . P — a. s. 

n— >oo 7^ 

k=l 



Since fo(t) is regularly varying, Chernoff's bound (Cramer's large deviation theorem for coin 
flipping, see [13]) applied to the partial sums Y^k=\Bk implies that 

< limsup/i(t) • P<j,(0 o oX > t; C t , £ ) < lim sup ^(t) ■ P*( V _ B k > t) = 0. 

Next, by the conditions of the lemma, 

lim h(t) ■ P$(0 O o X > t; P tj£ ) < lim fc(t) • P$(P t>£ ) 
= [(0 O 1 - - (0 1 + 0. 
Finally, using again the large deviation principle for ^ k=1 B k , 

lim inf h(t) ■ P$ U o X > t; A* £ ) = lim inf hit) ■ [p # (A e ) - P$ (0 O o X < t; A t e ) 
> lim inf h(t) • P $ (A t>£ ) = (0Q- 1 + e)- a . 

On the other hand, clearly, 

lim inf hit) • P 4 (0 O o X > t; A t£ ) < lim inf h(t)-PJA t£ ) = (0 o 1 + £ r Q . 

Since e > is arbitrary and (0Q -1 + e)~ a — >■ 0q as e goes to zero, this completes the proof of 
the lemma. □ 

Remark 3.2. The above proof of Lemma \3.1\ can be adopted without modification for a more 
general type of sums Ylk=i Bk, where X G A/+ has regularly varying distribution tails and 
(P/c)fc g N are independent of X. In fact, the only property of the sequence B k required by the 
proof is the availability of a non-trivial large deviations upper bound for its partial sums. 
Note that if /(A) := P$ [e ABl ] is finite in a neighborhood of zero, such a bound in the form 

> x) < c(x)e~ nI ^ with suitable constants c(x),I(x) > holds 



( i ELi B k - E t> [Bi 



for any x > (see, for instance, the first inequality in the proof of Lemma 2.2.20 in JJE/). 
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Recall (see, for instance, [151 Lemma 1.3.1]) that if X and Y are two independent random 
variables such that lim^oo h(x) ■ P(X > x) = C\ > and lim^oo h(x) ■ P(Y > x) = c 2 > 
for some h G lZ a , a > 0, then 

lim h{x) ■ P{X + Y >x) = c 1 + c 2 . (13) 

Using this property and iterating (PQ), one can deduce from Lemma [331 the following corollary. 
Consider (in an enlarged probability space, if needed) a sequence X = (^n) ngZ+ which solves 
JTJ), that is a sequence such that 

Xn—l 
k=l 

for some initial (not necessarily equal to zero) random value Xq. 

Corollary 3.3. Let Assumption \2.1\ hold and suppose in addition that the following two 
conditions are satisfied: 

(i) X is independent of (<p k , B k , Z k ) k>0 , where B k = (B kd ) jeN . 

(ii) lim^oo hit) ■ P$(X > t) = c for some random variable Co = Co($). 

Then lim^oo h(t) ■ P$(X n > t) = c n for any nGN, where the random variables c n = c n ($) 
are defined recursively by 

Cn+i = c n <f)% +1 + 1, n £ Z_|_. (15) 
The recursive relation ( ITS]) implies that 

n n n 

c n = c n + c JJ 0J, where c„ = 1 + ^ II ' ( 16 ) 

j=l k=2 j=k 

and hence (see, for instance, Theorem 1 in [8]) the random variables c n converge in distri- 
bution, as n — > oo, to 

oo k 

coo-.= i + J2U^- 

k=0 i=0 

Furthermore, we have the following: 

Corollary 3.4. Suppose that the conditions of Corollary \3.3\ are satisfied and, in addition, 
there exist a positive constant C > and such that the following holds: 

P(sup{h(t) ■ PJX > t) \ < C) = 1. 

Then the following limit exists and the identity holds: 

lim h{t) ■ P(X n > t) = E[c n }, neN, 

where c n are random variables defined in flTHJ) . 
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Proof of Corollary 3. 4, Corollary 13.31 and the bounded convergence theorem imply that 

lim hit) ■P(X n >t) = lim hit) ■ E\PjX n > t)] 

= E [lim h(t) ■ P 4 (X n >t)}= E[c n }. (17) 



To justify interchanging of the limit with the expectation, observe that X n < X + Yl k =i ^ k 
and hence, by virtue of assumption (A3), the following inequalities hold with probability 
one for some positive constant C\ > : 

n 

h(t) ■ P$ (X n > t) < h(t) ■ Pj, (X > t/2) + h(t) ■ P$ Z k > 

k=l 

< h(t) ■ P$(X > t/2) + nh{t) -P(Z > t/{2n)) 



h(t/2) h(t/(2n))' 
It follows (see, for instance, [201 Lemma 1]) that there exists a constant Ci > such that 

P(sup{h(t) ■ PJX n >t)}<C 2 )= 1. 

H>t J 

This enables one to apply the bounded convergence theorem in ffl7|) and thus completes the 
proof of the corollary. □ 

In what follows notations X <£> Y and X >£> Y for random variables X and Y are used 
to indicate that P(X > t) < P(Y > t) or, respectively, P(X > t) > P(Y > t) holds for all 
t £ R. In order to exploit Corollary 13.41 in the proof of Theorem 12.51 we need the following: 



Lemma 3.5. Suppose that the conditions of Corollary 3.4 are satisfied. Then: 

(a) If Xq <£> X\, then X n < D X n+ i for all n G N. 

(b) If Xq > d X 1 , then X n > D X n+1 for all n e N. 

Proof of Lemma [3751 The proof is by induction. Suppose first that X n _i <o X n for some 
n e N, X n „i is independent of {<j) k , B k , Z k ) k> n-i, and X n is independent of (<p k , B k , Z k ) k>n . 
We will now use the following standard trick to construct an auxiliary random pair (V n -i, V n ) 
such that 

P(K-i < K = 1), V n - 1 = P X n - 1 , and V n = P X n . (18) 

Let U be a uniform random variable on [0, 1], independent of the random coefficients sequence 
($, Z). Denote by F n and P„_i, respectively, the distribution functions of X n and X n _i. Set 
V n = F-\U) and 1/ n -i = K-iiP), where F~ l {y) := inf{x G R : F(x) >y},yE [0, 1], with 
the convention that inf = oo. 

Let X n+1 = <p n+ i o X n + Z n+l . Then X n+1 is independent of (<p k , B k , Z k ) k>n+1 . Further- 
more, since (V n -i, V n ) is independent of ($, Z), we obtain for any t > 0, 

P(X n +l > t) = P(0„+1 O X n + Z n+1 > t) = P(0 n+ l oV n + Z n+1 > t) 

> P((f> n+1 oV n _ 1 + Z n+1 >t)=P( ( j) n oV n „ 1 + Z n >t) (19) 
= P((f> n oX n ^ + Z n >t)=P(X n >t). 
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This shows that part (a) of the lemma holds true. The same argument, but with < replaced 
by > and vice versa in the base of induction, ( JT8]) . and (|T9|) . yields part (b). □ 

We are now in a position to complete the proof of Theorem 12.51 First, we have: 

Lemma 3.6. There exists a random variable X > satisfying the conditions of Corol- 
lary \3.4\ such that X x > D X . 

Proof of Lemma \3.6l Set X = Z_\. □ 

In view of Lemma I3.5[ this implies that we can find a sequence X n that solves ([1]) and 
such that X n <jj X^, while X satisfies the conditions of Corollary 13.41 Combining this 
result with the conclusion of the corollary yields: 

liminf h(t) ■ P(X co > t) > lim h(t) ■ P(X n > t) = E[c n ], neN. 

t— >oo t— >oo 

Hence 

liminf h{t) ■ PiXcc >t)> lim E[c n \ = \-— . (20) 

On other hand, we have 

Lemma 3.7. Let Assumption \2. 1\ hold. There exists a random variable X > satisfying 
the conditions of Lemma \3.1\ and such that Xi < D X . 

Proof of Lemma \3. 7[ Given a realization of the sequence $, choose a constant cq in such a 
way that 

1 

CO> l-£[0o]' 

Let Y = cj a Z-\. Then lim^oo h(t) ■ P(Y > t) = cq. If we would choose X = Y , we would 
have ci := lim^oo h{t) ■ P(Xi > t) < c by virtue of (|T5|) and Corollary 13.41 This would 
imply that P{X\ > t) < P{X$ > t) for t > to, where to > is a positive constant which 
depends on cq. Consider now (in an enlarged probability space, if needed) a random variable 
X such that X is independent of (<pk, B k , Z k ) ke z and 

P(X >t) =P(Y >t\Y >t ). 

Note that such X satisfies the conditions of Corollary 13.41 because P<s>(X > t) = P(X > t) 
with probability one, and for t > to, 

and sup t>0 h{t)/h{tcQ a ) < oo (see, for instance, Lemma 1 in |20j). Then, for t > t , 

P(<p 1 oX + Z 1 >t) = P(<p 1 oYo + Z 1 >t\Y >t ) 

P(<j )l oYo + Z 1 >t;Yo>to) P(0! o Y + Z t > t) 
P{Yo > t ) ~ P(Y > to) 

^ ^^TT = P(Yo>t\Y >to) = P{Xo>t). 
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On the other hand, if t < to then 

P(X >t) = P(X > t\X > t ) = 1. 

Thus 

P(0i o X + Z x > t) < P(X > t) 

for all t > to, and we can set Xq as the initial value for the recursion. □ 
Combining this result with Corollary 13.41 yields: 

limsup h{t) ■ P(Xoo >t) < lim h(t) ■ P (X n > t) = E[c n ], neN. 

Hence, 

limsup h(t) ■ P{X O0 > t) < lim E[c n ] = \- — . 

The proof of Theorem 12.51 is completed in view of ( 120|) . 



3.2 Proof of Theorem [2T61 

For neN, denote K n = maxi<fc< n Z^. It follows from (CQ) that M n >d K n . To conclude the 
proof of the theorem, it thus suffices to show that 

lim sup Po{M n > xb n ) < lim P (K n > xb n ) = e~ x , x > 0. 

n— s-oo n— >oo 

Observe that, under the stationary law P, the branching process (without immigration) 
originated by the initial Xq individuals will eventually die out. Therefore, the total number 
of progeny of the individuals in the zero generation is P — a. s. finite. Furthermore, the 
branching process X n — J2°k=-oo Xk,n, ti£N, obtained by excluding the contribution of these 
individuals from the original one, is distributed under P as X n , n e N, under P Q . It thus 
suffices to show that 

lim sup P{M n > xb n ) < lim P(K n > xb n ) = e~ x ~ 1/a , x > 0. 
Toward this end, define the following events. For x > 0, 5 > 0, and e G (0, 1/2), let 



An) 
n x,S 


= {xb n 


B (n) 
x,o,e 


= Ai :h 


/~i(n,k) 


= A %\ 


n (n,k) 


= Ai :h 



a( x} f]i x k > xb n , exb n < Z k < x(l - e)b n }, fi6N, k = l,...,n, 
A x} C\{ Xk > xhn > Zk - X£bn ^ neN > k = l,...,n. 
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Then 



j(n,fc) 
x,S,e 



n n 

p(a%) < p{b { :d + p(u c£ff) + P(|J D 

k=l k=l 

< P(x(l - e)b n <K n < x{l + 5)b n ) +nP{C ( ^) +nP(D%$). (21) 



Taking into account the independence of the pair ((/>£., A/^) of Z^, it follows from 
Assumption I2.1[ and Lemma 13.11 that for any positive constants S, x, e > 

limsup n P (C^^) < lim nP(d>x o X > exb n , Z\ > exb n ) = 0. 

n— >>oo n— >>oo 

Furthermore, 

P{D%£) < P(0i o X > (1 - e)xb n , X < x(l + S)b n ) 

<P(0ioX o > [1 - e)xb n \X < x{l + 5)b n ) <p( B ,i > {1 - e)xb n ^ 

i=l 



(22) 



E 



P, 



\x{l+5)b n \ 



x(l + 5)b n 



E s «w>i 



l-e 



i=l 



5 



(23) 



Assume now that the constants 5 > and e > are chosen so small that jj^ > E[(f) ], and 
hence 



l-e 

TT7 



> ryP[0o] for some 77 > 1. 



(24) 



We next derive a simple large-deviations type upper bound for the right-most expression in 
(I231) . Denote x = y^|. It follows from Chebyshev's inequality that for any A > 0, 



E 



P * E B ^ > ^ e" nA *°P[(l - 0o + 0oe A )"] . 

i=l 



Thus for all A > small enough, namely for all A > such that e A < 1 + 77A, we have 



E 



l-e 



P*{-z2 B ^ > — 6 )\ ^ e~ nXx °E[(l- - 0o + 0o(l + ^A)) n ] 



i=i 



= e- nXxo E[{l + <p i]\) n ] < e - nXxo E[e^ nvX ] . 
Therefore, for all A > small enough we have 



lim sup — log E 

n— >oo IT' 



P*(±Y, B <* > IT!)] - -^o + logP[e^] 

i=i 



Given 77, let /(A) = logE[e***°]. By the bounded convergence theorem, /'(0) = r]E[(j) ]. 
Hence, in view of ( )24l) . 



1 1 n 1 

lim sup - log P (- E B ^ > TtI) < 
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Since b n is a regularly varying sequence, it follows from (|23|) that 

lim nP(D^ £ ) = 0. (25) 

n— >oo >!' 

Therefore, since e > above can be made arbitrary small (in particular, the left-hand side 
of ff24l) is an increasing function of e), combining ( 125]) together with (122]) and (123]) yields: 



limsupP(43) < P(x6 n < if„ < x(l + <*)&„), 

and hence 

OO 

lim sup P(M n > xb n ) = limsup^P((l + k5)xb n < M n < (1 + k5 + 5)xb n ) 

n— >oo n— ¥00 k —Q 
oo 

< lim sup P ((1 + £;<5)x6 n < M n < (1 + k5 + 5)xb n ) 
k=o n ^°° 

oo 

< P (( x + < < (1 + H + 5)x6 n ) = P[K n > xb n ). 

k=0 

The proof of Theorem 12.61 is complete. □ 



3.3 Proof of Theorem I2JT1 

For fifZ, let 



Y n = J2Xn,t (26) 



t=n 



be the total number of progeny at all generations of all the immigrants entered at time n, 
including the immigrants themselves. Then 



n k n n n oo 

V ^ k 



k=l t=0 t=0 k= 

n n oo 

Notice that 

E E =» EE X '^ E E A '< 

=—n k=l t=—oo k=l 

oo v\ 

E E A «£ E « 



k=l k=l t=0 t=0 k=t t=0 k=t k=n+l 

n n oo 

H,k- 

t=0 t=0 k=n+l 



n oo oo oo 



t=0 k=n+l t=—n k=l t=—oo k=l 

oo v\ 

< ^ • 

t=— V-i k=l t=—v-\ 
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Hence, in order to show that S n /b n converges in distribution, it suffices to show that 
b~ x Ylk=i converges to the same limit. Note that the sequence (Y n ) ne z has the same 
distribution under P as it has under P. 

The following series of technical lemmas will enable us to apply a general stable limit 
theorem (namely, Theorem 1.1 in [46J; see also Corollary 5.7 in [29J) to the partial sums of 
the sequence Y n . 

Lemma 3.8. The sequence (V n )ngz is strongly mixing. That is, lim^oo x{ n ) = 0? where 

X (n) := sup{P(A n B) - P{A)P{B) :Aer i ,Be F }, 
and J 7 ™ := a(Yi : i > n), Tn := u{Yi : i < n). 

Proof of Lemma \3. 81 This is a variation of Lemma 3.2 in [H]. For the sake of completeness 
we give here a suitable modification of the argument. For n G Z, let y n and y n denote, 
respectively, the sequences (Yi) i<n and (Fj)j> n . On one, for any A G a(Yi : i > n) and 
B G a(Yi :< 0), 

P{y n £A,y eB)> p(y n eA,y e b, v x < n/2) 

= E[P*(y G B, vx < n/2) ■ P*(y n G A)] 
>P(y e B, v x < n/2) ■ p(y n G A) 

> p(y g B) ■ p(y n eA)- p^ > n/2). 

On the other hand, 

P(y n eA,y eB)< p(y n eA,y e B,u, < n/2)+P{u 1 > n/2) 

= E[P$(y eB,^< n/2) ■ P^(y n G A)] + P{v x > n/2) 
<P(y e B, v x < n/2) -P(y n EA)+ P(y x > n/2) 
< P{y G B) ■ P(y n eA)+ P{y x > n/2). 

It thus remains to show that Piv\ < oo) = 1. By Proposition 12. 7\ we have Po{v\ < oo) = 1. 
Since, clearly, P((f>ioX = 0) > 0, the strong Markov property implies P{y\ < oo) > 0. Since 
the Markov chain (X n , Z n ) forms an ergodic process according to Corollary 12. 4[ it follows 
from the ergodic theorem that the the two-component Markov chain spends asymptotically 
a positive proportion of time at the set {X n = Z n } (one can also appeal directly to the 
Poincare recurrence theorem). This completes the proof of the lemma. □ 

In view of the previous lemma we are seeking to apply to Y n the following general limit 
theorem for strongly mixing stationary sequences obtained in jl6] (see also a similar Corol- 
lary 5.7 in [29]). 

Theorem 3.9. fcffl Theorem 1.1 and Corollary l.j.] Let (Y n ) n( z^ be a stationary strongly 
mixing sequence of non-negative random variables. Assume that for some a G (0, 1), there 
exists h G lZ a such that lim^oo h(t) ■ P(Y n > t) — 1. For nGN, define a process U n on the 
Skorokhod space D(R + ,M.) by setting 

[nt\ 

u n (t) = -J2 Y k, *>o, 
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where b n are defined in ([9]). Then U n converges weakly in D(R + ,M), as n — )■ oo, to a Levy 
a-stable process if and only if the following local dependence condition holds: 

[n/k\ 

For any e > 0, we have: lim lim sup n ) P(Yj > eb n , Y\ > eb n ) = 0. (27) 

We remark that the assumption P(Y n G Z+) = 1 is actually not needed and is not 
included in the original version of the above theorem, as it is stated in [46J. It is not hard 
to verify that in our setting the random variable Y\ has regularly varying distribution tails 
under the law P&. To transform this statement into a corresponding claim under P we will 
need the following a-priori bound. 

Lemma 3.10. Let Assumption \2.1\ hold. Then 

lim sup h{x) ■ P{Y X > x) = C < oo, (28) 

x— >oo 

where C G (0, oo) is a positive constant whose value depends on the distribution of <po but not 
on the distribution of Z Q (as long as Assumption \2. 1\ holds and h(x) is defined as in (A2)). 

Proof of Lemma \3. 1 (A For any x > and 7 G (0, 1), 

p(Xi >x) = pQrx 1>n > x{\ - 7 ) 5> n_1 ) ^ E p ( x ^ > x ^ n " 1 ( 1 - 7))- 

n=l n=l n=l 

Therefore, 

00 

lim sup h{x) ■ P{Y 1 > x) < ^limsup/i(x) ■ P(X x , n > x 7 n " 1 (l -7)) 



00 



^hmsup ^ ■ ^(^(l - 7)) " P(X liB > x 7 "- 1 (l - 7)) 

h(xj n ~ l {l — 7) J 



7t = l 

OO 

^ 7 - Q ("- 1 )(l - 7 )- Q .limsupA(ar) • P(X 1>n > x) 

-. x— >oo 

71=1 



Applying Lemma 13.11 to the right-most expression in this inequality, we obtain by virtue of 
the bounded convergence theorem that 

00 

limsup/i(x) -P(Yi >x)< ^ 7 - a(n - 1} (l -7)" a • ^[lim h(x) ■ P^(X 1>n > x) 

x— >oo , lx— ¥00 

71=1 

OO 

= ^( 7 ^- J E[^]) n " 1 (l-7)- Q . 



71 = 1 



Choosing now 7 G (0, 1) such that 7 > E[</>q] concludes the proof of the lemma. To justify 
the above application of the bounded convergence theorem, observe that X l n < Zi and Z\ 
is independent of □ 
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In order to study the exact asymptotic of the distribution tails of Y±, it is convenient to 
approximate Y\ by Y^ m \ where 



n+m 



k=n 



We have: 

Lemma 3.11. Let Assumption \2. 1\ hold. Then 



lim h(x) ■ P(Y} m) > x) = e\{\ + V TT 



i=l j=l 



for any m G N. 

Proof of Lemma \3.11\ Note that 



(29) 



y(m) 



k=l 



i=l 



where _B^ fc is the number of progeny (either zero or one) of the k-th immigrant at generation 
n, who is present (or not) at the system at generation n + i. Then an argument similar to 
the one which we have employed in order to prove Lemma 13.11 (see also Remark 13. 2j) along 
with (TIB"]) ensure that 

m mi 

Jim h(x) ■ P $ (Yt ] >x) = (l + J2 E * [<} ) ° = (l + E II *i) " 



i=l j=\ 



Since E (m ' ) < mZ and Z is independent of $, the bounded convergence theorem yields 

m i 

lim h(x) ■ P(Y (m) > x) — E\ lim /i(ar) • P$ (E (m) > x)l = P \( 1 + V TT 0,- 

i=l j=l 

completing the proof of the lemma. □ 

Combining together the results of Lemmas 13.101 and 13.111 we can deduce the following: 
Lemma 3.12. Let Assumption \2.1\ hold. Then 



lim h(x) ■ P(Yx > x) = E (l + E II 



< oo. 

i=l j=l 

Proof of Lemma \3.12\ First, observe that the lower bound 

oo i 

lim h(x) ■ P(Yt >x)> lim lim h(x) ■ P(Yl m) > x) = E \( 1 + V TT fa 

i=l j=l 
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holds by virtue of Lemma 13.111 and the monotone convergence theorem. 

To prove the matching upper bound, notice that the difference Y\ — is distributed 
under the law P as Y\ is distributed under the law Q, where Q is defined in the same way 
as P with the only exception that in the former case the distribution of Z n is assumed to be 
that of Il m+ i o Z Q under P. Furthermore, since IT m+ i o Z < Z , Lemma [3TT1 and the bounded 
convergence theorem imply that 

lim h(x) ■ P(n m+1 o Z > x) = (E[ffi]) m+1 . 

x— ¥00 

It follows then from f[2"gj) with the probability measure P replaced by Q, that 

lim limsup/i(x) • P(Y\ — Y" 1 < - m - > > x) = 0. 

Thus, using again Lemma 13.111 and the monotone convergence theorem, we obtain that the 
following holds for any e > : 

lim sup h(x) ■ P(Yi > x) 

x— ¥00 

< lim { lim h(x) ■ P(Y} m) > x(l - e)) + lim sup h(x) ■ P(Y X - Y} m) > xe) } 



lim lim h(x) ■ P(Y} rn) > x(l - e)) = E 



m— ¥00 x— ¥00 



En 

i=l j=l 



Taking e — > yields the desired upper bound. To conclude the proof of the lemma it remains 
to note that by Jensen's inequality, 



E 



i+En 



< E 



i=l 3=1 

where we used the assumption a G (0, 1) 



i=i 3=1 



:(1-P[0 O ]) Q <00, 



□ 



We are now in a position to complete the proof of Theorem 12.111 It suffices to verify 
that the conditions of Theorem 13.91 hold for the sequence (Y n ) n >i. In view of Lemmas 13.81 
and 13.12] we only need to check the validity of the "local dependence" condition f l2T|) . To 
this end, observe that for any j > 2, Yj and Y± are independent under the law P^, and hence 
Cauchy-Schwarz inequality yields 

P(Yj > eb ni Y x > eb n ) = E[P^{Y 3 > eb n ) ■ P*{Y X > eb n )] < E[Pl{Y x > eb n )]. 

An argument similar to the one we employed to prove Lemma 13.121 shows then that the 
following limit exists and the identity holds: 



lim h(x) 2 ■E[P£(Y 1 >x)] =e\(i + J2H 



2a- 



i=l j = l 



< OO. 
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Thus 



OO I 

lim n 2 •E[li{Y 1 > eb n )] = e~ 2a ■ E \( 1 + V TT 



2a 



i=l i=l 



< OO, 



and 



[n/fcj 2 

P(V, > £& n , Yi > £& n ) < lim lim sup — ■ E\Pl(Y\ > eb n 

- • o fe -*°° n->oo ft L 

J =2 



, , = o, 

t=l 3=1 



= lim limsup^ r -n- 2 £- 2a - J B[(l + ^ JJ, 

1=1 j=l 

as desired. The proof of Theorem 12.111 is completed. □ 

3.4 Proof of Lemma [2331 

Recall Y n from $23). Define 

Q n = X n + total progeny of the X n particles present at generation n. 

For all A > define its stopping time = inf{n : X n > A}. The random variable W\ can 
be represented on the event {c^ < v{\ in the following form: 

W 1 =Y J X n + Q, A + r «- ( 3 °) 

n=0 <,A<n<vi 

The three terms in the right-hand side of ( 1301) are evaluated in the following series of lemmas. 
It will turn out that for large A, the main contribution to W\ in ( 1301) comes from the second 
term. Fix any S > 0. It follows from (fTTj) that for any A > 0, 

min{? Ai v l}~ 1 

-K 2 st/A 



n=0 

and hence 



P ( ^ > 8tj < Po(Au! > St) < K ie - 



P (^i > St, c A > vi) < P{Av x > St) < K ie - K2St/A , (31) 



TA-l 



Po(J2 X - ^ 5t ^A < ^i) < Po(M > < ^ie- X25iM . (32) 



n=0 



Lemma 3.13. For all 5 > i/iere exists an Aq = Aq(S) < oo such that 

h{t) ■ P ( > ft) < 5, for all A > A and t > 0. (33) 



22 



Proof of Lemma \3. 131 Using the identity Y^=i n 2 = 71 " 2 /6 < 2 and the fact that Y n is 
independent of l^ A<n<Ul y under the law P , we obtain that the following holds for all £ > : 



oo oo 



h (t) -Po( Y n>$t)= h(t) ■ P (j2YnM< A <n<v l} > 6^ ]T n~ 2 ) (34) 

c A <n<ui n=l n=l 



OO 



< P o(^a < n < v x ) ■ h{t) ■ P {Y n > 1/2 • 5tn- 2 ) 



n=l 

oo 



< J2 P o^a <n<u l )- ^ _ • h{\/2 ■ 5tn- 2 ) ■ P (Y n > 1/2 • 5tn~ 2 ) 



n=l 



h(l/2-5tn- 2 ) 

h(l/2-5tn~ 2 ) ' 



To bound the term rni^-=T) , we apply the following simplified version of [201 Lemma 1]: 



There exists K > 1 such that < K(\~ a + X a ) for all A > 0, t > 0. (35) 

h(t) 



It follows that 

k ® <K2 a n 2a {5- a + 5 a ), t>0. 



h(l/2 ■ (Jin- 
Using Lemma [3.121 and (|35|) . we obtain from ( 13"4"]) and the above bound that the following 
holds for allt > with a suitable constant C > independent of n, 5, A and t : 

h(t) ■ P ( Yl Y n>5t)< C2 a r a (6~ a + 6 a )E [v 2a+1 ; q A < v x ] 



c A <n<ui 



< C2 a r a (6- a + 5 a ) y/E (vf 3,+2 ) ■ y/P (<; A < vi). 

The claim follows now from ( TTTT) . the first square root being bounded and the second one 
going to zero as A — > oo. □ 

It follows from (|30l . taking estimates (13T|) . (1321) and (|33|) into account, that for any 
A > A (8) (where A is given by (133]) ) there exists t A > such that 

/l(t) • P (?A < fl, Q u >t)< h{t) ■ P (Wx > t) 

< h(t) ■ P (^4 < u lt Qc A > t{\ - 25)) + 35, (36) 

for all t > tA- Thus, W\ can be approximated by Q qA . The following lemma deals with the 
distribution tails of the latter. 

Lemma 3.14. Let Assumption l2J\ hold. Then: 
(a) We have: 

limsup limsup/i(£) • Po[X u > t, ca < vi) < oo. (37) 

A— >0O t— S-OO 
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(b ) The following limit exists and is finite for any given A > : 

lim h(t)-P (X, A >t,<; A <vi). 

(c) The following limit exists and is finite for any given A > : 

lim h{t)-P (Q, A >t,q A < v x ). 



t— >oo 



Proof of Lemma \3.14 



(a) Recall M n from ([8]). For t > A we have: 

A-l 

Pq{X <;a > t; g A < v x ) = ^ ^ P (^? A > *> = n, X n > A, X n _i = a, v x > n) 

n>l a=0 

A-l 

= y Y p ° ( Xn > £ > Mn ~ i < A; = a ' Vx > n ) 

n>l a=0 

< Y p { z n > t - A, M n _! < A, v x > n) 

n>l 

= J2 P ( Z n>t-A)- P(M n _! < A, v x > n) < P(Z > t - A) • P N- 



n>l 



In view of Assumption 12. II and ( ITT]) , this completes the proof of part (a). 

(b) The computation is quite similar to the one in part (a). Namely, for t > A we have: 



A-l 



P (X CA > t; q A < v\) = Y ^2 P ° { Z n>t~ a, <f) n ° X n _i = a, M n _i < A, v x > n) 

n>l a=l 

A-l 

= Y/Z P ( Z ° >t-a)-P {(fi n oX n - 1 = a,M n _ x < A,v x > n). 

n>l a=l 
A-l 

= y p ( z o > t - a ) ■ Y P °(^ n ° Xn - x = fl ' Mn ~ l < A > V 1> n ) 



a=l n>l 

As before, 

Y p o{<fin o X n _! = a, M n _! < A,u > n) <Y p o{"i > n) = £7[i/J < oo, 

ri>X n>l 

from which the claim of part (b) follows in view of Assumption 12.11 

(c) This is merely Lemma f3 . 1 21 applied to X qA under the conditional law P( • | <; A < u±) rather 
than to Z\ under the regular measure P. □ 
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We are now in a position to conclude the proof of Lemma \2. 131 It follows from (|36|) . ( 135]) . 
and Lemma [3.141 that 

lim h(t) ■ P (Wi > t) — lim lim hit) ■ Po{Q iA > t; q A < ^i) < oo. 

t— >oo A— >oo t—too 

The second limit, taken as A — > oo, in the right-hand side exists since the limit in the 
left-hand side does not depend of A. Furthermore, by Assumption I2.1[ 

lim h(t) ■ P Q {W X >t)> lim h(t) ■ P(Z 1 > t) > 0, 

t— ¥oo t— >oo 

concluding the proof of Lemma 12.131 □ 



Appendix: Proof of two auxiliary propositions 
Proof of Proposition 12.31 

(a) By Jensen's inequality, if E[Zq] < oo for > 0, then E[Z{j /m ] < oo for any m G N. 
Therefore, without loss of generality we can assume that f3 G (0, 1) in Assumption 12.21 
Assuming from now on and throughout the proof of part (a) of Proposition [2]3] that G (0, 1), 
we obtain by virtue of Jensen's inequality for conditional expectations that 

E [(U k oZ k f] =E [E [(Tl k oZ k f\<S>,Z]] < E [(E [U k o Z k \$, Z] f] 



= E\ 

Hence 



[(fl^rZ k y]=E[z^].(E[4]) k . (3* 

3=1 



k=0 k=0 k=0 

In particular, Xoo is P — a. s. finite, 
(b) For n G N, we have 

n 



k=l 



where X^°' n ^ = P U n o X . Since P(lim n _ i . 00 Il n o X = 0) =1 for any X G Af + , the limiting 
distribution of X n , if exists, is independent of X . Furthermore, if X = 0, the i.i.d. structure 
of ($, Z) yields: 



n-l 



x n —p x kt0 —p z + rifc o z k , 

k=-n+l k=l 

The claim of part (b) follows now from the almost sure convergence of the series on the 
right-hand side of the above identity to X^. 
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(c) To see that the stationary distribution is unique, consider two stationary solutions 
{Xn) neZ and {Xn ) neZ to (CQ) corresponding to different initial values, X„ and Xn\ 
respectively Then, since U n are "thinning" operators, 

\x^-x^\<u n+1 o\x^-x^i 

and hence 

lim (Xjp - X^) =0, P - a. s. 
The proof of the proposition is complete. □ 

3.5 Proof of Proposition 12.71 

(a) By Corollary 12.41 Po(X n = fc min i. o.) = 1, and hence Po{v n < oo) = 1 for all n e N. 
The argument showing that the pairs (<r n , W n ) ne ® form an i.i.d. sequence is standard (cf. 
[3]) and is based on the following two observation along with the use of the strong Markov 
property: 

(i) The random times v n are times of the successive visits to the set {(x, y) G 7? : x = y} 
by the two-component Markov chain (X n , Z n ) n( zfq. Furthermore, X Un = Z Un =p Z . 

(ii) Transition kernel of the Markov chain (X n , Z n ) depends only on the current value of 
the first component, but not on the value of the second. 



(b) In order to prove part (b) of the proposition, it suffices to show that the following power 
series has a radius of convergence greater than 1 : 



V(Z) = X>0(<71 >*)**. 



t=0 

Let us introduce some notation. Let v(t) = Po(°"i > t), 

t-i t-i 
h(r,t) = P(x r , t 0, X ^ = °) and 9(r,t) = p(J^ X ^ = °)" 

j=r+l j=r 

Then 

t-i 



;(t) = P o (a 1 >t,X t ^0) = P Q (a 1 >t,Y / X k ,t^0^ 

k=0 

t-2 t-1 

= $^^o(^i > t,X ktt ^ 0, X k,t = O) +Po(°i > t,X t ^ t ^ 0). (39) 



k=0 j=k+l 
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Using the i.i.d. structure of the sequence of random coefficients ($, Z), we obtain: 

t-i t-i 



P (^i > t,X ktt ^ 0, ^ X M = o) = Pq(<ti > k,X ktt 7^0, J2 Xk * = °) 

j=k+l j=k+l 
t-1 

= P ( ffl > k)p(x ktt ^ 0, X Kt = 0) = v(k)h(k,t) (40) 

i=fc+i 

and 

<?(M) = ^PQ-fc = 0). (41) 
Let g(t) = P (X t = 0). ft follows from QHJ that 

g(k,t) = g(t-k). (42) 
Next, let /i(t) = g(t - 1) - </(*). Since h(A;,t) + g<(M) = g(k + l,t), then (g2J implies that 

h(k,t) = h(t- k). (43) 

Substituting (j4"0~|) into ( 139|) and then using (143]) gives 

t-i 

u(t) = ^ v(k)h(t - k). 

k=0 

In addition, we have v(0) = 1, /i(&) > for all k > 0, and 

oo 

h(k) = 1 - lim git) = 1 - lim P (X t = 0) < 1, 



4— >oo t— >oo 
fc=l 



where for the last inequality we used Theorem 3.3. Therefore, {v(k) : k — 0, 1, 2, . . .} is a 
renewal sequence. Therefore (see HE1 Section X111.3]), V(z) = (l - H(zj) , where 

oo 

H(z) :=Y;h{t)J. 
t=o 

To conclude the proof of the proposition, observe that, using (13"5|) and Chebyshev's inequality, 

hit) = h(0,t) < P(X 0tt ^ 0) < E[X , t ] = E[Z$] ■ {E\4})\ 
and hence the radius of convergence of H(z) is greater than 1. □ 
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